A possible role of midbrain dopamine neurons in short- and long-term adaptation of saccades to position-reward mapping.
نویسندگان
چکیده
Dopamine (DA) neurons respond to sensory stimuli that predict reward. To understand how DA neurons acquire such ability, we trained monkeys on a one-direction-rewarded version of memory-guided saccade task (1DR) only when we recorded from single DA neurons. In 1DR, position-reward mapping was changed across blocks of trials. In the early stage of training of 1DR, DA neurons responded to reward delivery; in the later stages, they responded predominantly to the visual cue that predicted reward or no reward (reward predictor) differentially. We found that such a shift of activity from reward to reward predictor also occurred within a block of trials after position-reward mapping was altered. A main effect of long-term training was to accelerate the within-block reward-to-predictor shift of DA neuronal responses. The within-block shift appeared first in the intermediate stage, but was slow, and DA neurons often responded to the cue that indicated reward in the preceding block. In the advanced stage, the reward-to-predictor shift occurred quickly such that the DA neurons' responses to visual cues faithfully matched the current position-reward mapping. Changes in the DA neuronal responses co-varied with the reward-predictive differentiation of saccade latency both in short-term (within-block) and long-term adaptation. DA neurons' response to the fixation point also underwent long-term changes until it occurred predominantly in the first trial within a block. This might trigger a switch between the learned sets. These results suggest that midbrain DA neurons play an essential role in adapting oculomotor behavior to frequent switches in position-reward mapping.
منابع مشابه
Reward-predicting activity of dopamine and caudate neurons--a possible mechanism of motivational control of saccadic eye movement.
Recent studies have suggested that the basal ganglia are related to motivational control of behavior. To study how motivational signals modulate motor signals in the basal ganglia, we examined activity of midbrain dopamine (DA) neurons and caudate (CD) projection neurons while monkeys were performing a one-direction-rewarded version (1DR) of memory-guided saccade task. The cue stimulus indicate...
متن کاملReward prediction error computation in the pedunculopontine tegmental nucleus neurons.
In this article, we address the role of neuronal activity in the pathways of the brainstem-midbrain circuit in reward and the basis for believing that this circuit provides advantages over previous reinforcement learning theory. Several lines of evidence support the reward-based learning theory proposing that midbrain dopamine (DA) neurons send a teaching signal (the reward prediction error sig...
متن کاملVentral Tegmental Area Microinjected-SKF38393 Increases Regular Chow Intake in 18 Hours Food Deprived Rats
Ventral tegmental area (VTA) dopamine neurons play an important role in reward mechanisms of food intake, and VTA dopamine receptors exist on the terminal of glutamatergic and GABAergic neurons and regulate GABA and glutamate release. To our knowledge, there is no evidence to show that VTA D1 dopamine receptors play a role in regular chow intake. In this paper, the effect of SKF38393, a D1 rece...
متن کاملBurst-Timing-Dependent Plasticity of NMDA Receptor-Mediated Transmission in Midbrain Dopamine Neurons
Bursts of spikes triggered by sensory stimuli in midbrain dopamine neurons evoke phasic release of dopamine in target brain areas, driving reward-based reinforcement learning and goal-directed behavior. NMDA-type glutamate receptors (NMDARs) play a critical role in the generation of these bursts. Here we report LTP of NMDAR-mediated excitatory transmission onto dopamine neurons in the substanti...
متن کاملMultiple Timescales of Memory in Lateral Habenula and Dopamine Neurons
Midbrain dopamine neurons are thought to signal predictions about future rewards based on the memory of past rewarding experience. Little is known about the source of their reward memory and the factors that control its timescale. Here we recorded from dopamine neurons, as well as one of their sources of input, the lateral habenula, while animals predicted upcoming rewards based on the past rew...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Journal of neurophysiology
دوره 92 4 شماره
صفحات -
تاریخ انتشار 2004